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Abstract 



Let game B be Toral's cooperative Parrondo game with (one-dimensional) 
spatial dependence, parameterized by N > 3 and Po,Pi,P2,P3 £ [0,1], and 
let game A be the special case po — p\ = p-2 = Pz — 1 /2. In previous work 
we investigated hb and ^(1/2,1/2), the mean profits per turn to the ensem- 
ble of N players always playing game B and always playing the randomly 
mixed game (1/2)(A + B). These means were computable for 3 < N < 19, 
at least, and appeared to converge as N — > 00, suggesting that the Par- 
rondo region (i.e., the region in which /j,b < and fJ>n/2,i/2) > 0) has 
nonzero volume in the limit. The convergence was established under cer- 
tain conditions, and the limits were expressed in terms of a parameterized 
spin system on the one-dimensional integer lattice. In this paper we re- 
place the random mixture with the nonrandom periodic pattern A r B s , 
where r and s are positive integers. We show that /X[ r ,s], the mean profit 
per turn to the ensemble of N players repeatedly playing the pattern 
A r B s , is computable for 3 < N < 18 and r + s < 4, at least, and appears 
to converge as N — > 00, albeit more slowly than in the random-mixture 
case. Again this suggests that the Parrondo region (/is < and /i[ r , s j > 0) 
has nonzero volume in the limit. Moreover, we can prove this convergence 
under certain conditions and identify the limits. 

Keywords: Parrondo's paradox; cooperative Parrondo games; Markov 
chain; stationary distribution; equivalence class; dihedral group; nonran- 
dom periodic patterns; strong law of large numbers. 

1 Introduction 

Toral [1] introduced what he called cooperative Parrondo games, in which there 
are N > 3 players labeled from 1 to TV and arranged in a circle in clockwise 
order. At each turn, one player is chosen at random to play. Call him player i. 
He plays either game A or game B. In game A he tosses a fair coin. In game 
B, he tosses a po-coin (i.e., po is the probability of heads) if his neighbors i—1 



Figure 1: Toral's spatially dependent, or cooperative, Parrondo games, with 
parameters N > 3 and po,Pi,P2,P3 € [0,1]- (A player's status as winner or 
loser depends on the result of his most recent game. Players are labeled from 
1 to N; player is player N and player N + 1 is player 1. A p-coin is one for 
which the probability of heads is p.) 
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choose a player, say i, at random 


choose a player, say i, at random 




1 


i tosses a fair coin 


check status of players i — 1, i + 1 


heads / 




\ tails 


• loser, loser: i tosses a po-coin 

• loser, winner: i tosses a pi-coin 

• winner, loser: i tosses a j»2-coin 

• winner, winner: i tosses a p3-coin 


i wins 1 


i loses 1 






and i + 1 are both losers, a pi-coin if i — 1 is a loser and i + 1 is a winner, a 
2?2-coin if 7 — 1 is a winner and i + 1 is a loser, and a p3-coin if i — 1 and i + 1 are 
both winners. (Because of the circular arrangement, player is player N and 
player TV + 1 is player 1.) A player's status as winner or loser depends on the 
result of his most recent game. The player of either game wins one unit with 
heads and loses one unit with tails. Under these assumptions, the model has an 
integer parameter, N, and four probability parameters, po, p\, p2, and p^. See 
Figure 1. 

Toral used computer simulation to show that, with N = 50, 100, or 200, 
Po = 1, pi = P2 = 4/25, and p^ = 7/10, game A is fair, game B is losing, 
but both the random mixture (1/2) (A + B) (toss a fair coin, play game A 
if heads, game B if tails) and the nonrandom periodic pattern AABB (i.e., 
AABBAABBAABB ■ ■ •), also denoted by [2,2], are winning, providing new 
examples of Parrondo 's paradox (Harmer and Abbott [2], Abbott [3]). Ethicr 
and Lee [4] investigated \ib and /U(i/2,i/2); the mean profits per turn to the 
ensemble of N players always playing game B and always playing the randomly 
mixed game (1/2) (A + B). These means were computable for 3 < N < 19, 
at least, and appeared to converge as N — > oo, suggesting that the Parrondo 
region (i.e., the region in which (1b < and ^(1/2,1/2) > 0) has nonzero volume 
in the limit. In [5] this convergence was established under certain conditions 
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on po,pi,p2,P3, and the limits were expressed in terms of a parameterized spin 
system on the one-dimensional integer lattice. In addition, assuming p\ = P2, 
explicit formulas for the means were derived for N = 3, 4, 5, 6, and this allowed 
us to visualize the Parrondo region in these cases. Incidentally, we note that the 
results can easily be extended to the more general random mixture r yA+{l— j)B, 
in which case the mean profit per turn is denoted by a- 

In this paper we replace the random mixture with the nonrandom periodic 
pattern A r B s , also denoted by [r,s], where r and s are positive integers. We 
show that Wr : s] i the mean profit per turn to the ensemble of N players repeat- 
edly playing the pattern A r B s , is computable for 3 < N < 18 and r + s < 4, 
at least, and appears to converge as N — > oo, albeit more slowly than in the 
random- mixture case. Again this suggests that the Parrondo region (/ig < and 
(J>\r,s] > 0) nas nonzero volume in the limit. Elsewhere [6] we establish this con- 
vergence under certain conditions onpo,Pi,P2,P3 (see Appendix A herein for the 

conditions), and show that the limit asJV^oo coincides with liniTv-^oo M(7,i At 

where 7 := r j (r + s). In addition, assuming p\ = P2, explicit formulas for fi[ riS ] 
can be derived for N = 3, 4, 5 and r + s < 3, and this allows us to visualize the 
Parrondo region in these cases. 

Nonrandom patterns of the form A r B s have been part of the Parrondo 
paradox literature from its inception (Harmer and Abbott [7]). The reason 
is clear. The flashing Brownian ratchet (Ajdari and Prost [8]), which moti- 
vated the formulation of Parrondo's games, is most closely related to the pat- 
tern AB (i.e., ABABAB ■ ■ ■). But this pattern is not winning for the original 
capital-dependent games, so Parrondo considered AABB instead. Analysis of 
these patterns was initially based on simulation. Analytical formulas for the 
mean profit per turn were found by Ekhad and Zeilberger [9] and Velleman 
and Wagon [10], and in the history-dependent setting by Kay and Johnson [11]. 
Behrends [12] generalized Parrondo's games in such a way that the random- 
mixture case and the nonrandom-pattern case could be studied simultaneously, 
and he too found an expression for the mean profit per turn. Ethier and Lee [13] 
proved a strong law of large numbers and showed that the Parrondo effect ap- 
pears (in the capital-dependent setting with the so-called bias parameter equal 
to 0) for the pattern A r B s for all integers r, s > 1 except r = s = 1. The 
problem of finding the most profitable pattern (not restricted to patterns of the 
form A r B s ) was investigated in [9] and [10] and eventually solved by Dinis [14], 
the winning pattern being ABABB (and its cyclic permutations) in the case of 
Parrondo's original parameters. In Toral's [15] nonspatial A-player model with 
redistribution of wealth, Ethier and Lee [16] showed that the mean profit per 
turn for the pattern A r B s converges, as N — > 00, to the mean profit per turn 
for the random mixture jA + (1 — "f)B with 7 := r/(r + s), which does not 
depend on N. This foreshadowed the results of the present paper and [6]. 
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2 The Markov Chain and its Reduction 



The Markov chain formalized by Mihailovic and Rajkovic [17] keeps track of the 
status (loser or winner, or 1) of each of the N > 3 players. Its state space is 
the product space 



E := {x = (x 1 ,x 2 , ...,x N ): Xi e {0, 1} for i = 1, . . . , N} = {0, 1} N 

with 2 N states. Let rrii(x) := 2xi-i +Xi + i; in other words, irii(x) is the integer 
(0, 1, 2, or 3) whose binary representation is (xi-i 2^+1)2; of course xq := xn 
and xn+i '■= X\. Also, let x % be the element of E equal to x except at the ith 
component; for example, x 1 :— (1 — x±, x 2 , X3, . . . , x/v)- 

The one-step transition matrix Pb for this Markov chain depends not only 
on TV but on the four probability parameters p 0l Pi 7 P27 an( l P3, which we 
assume satisfy < p m < 1 for m = 0, 1, 2, 3. (This rules out Toral's choice of 
the probability parameters, at least for now, but we will return to this point in 
Sec. 4. We do not assume that pi — p 2 until Sec. 5.) It has the form 

P B (^):={f>^ l Xi = ^ i=l,...,N, X eV, (1) 
[N q mi ( x ) 11 Xi = 1, 

P B (x,x) := N^( ^2 Qm i (x)+ X! Pmi(x)J, x e E, (2) 

^ i:Xi—0 i:Xi — l ' 

where q m := 1 — p m for m = 0, 1, 2, 3 and empty sums are 0, and Pb(x, y) — 
otherwise. 

The description of the model suggests that its long-term behavior should be 
invariant under rotation (and, if p\ = P2, reflection) of the N players. In order 
to maximize the value of iV for which exact computations are feasible, we will 
use the following lemma from [4] to make this precise. 

Lemma 1. Fix N > 3, let G be a subgroup of the symmetric group Sn- For 
x := (xi, . . . , xn) € E := {0, 1}^ and a € G, write x a := (x a ^, . . . , x a ^)) € 
E. Let P be the one-step transition matrix for a Markov chain in E with a 
unique stationary distribution tv. Assume that 

P(x a ,y a ) = P(x,y), creG, a;,yeE. (3) 

Then n(x a ) = ir(x) for all a G G and x G E. 

Let us say that x G E is equivalent to y G E ( written x ~ y) if there exists 
a G G such that y = x a , and let us denote the equivalence class containing x by 
[x] . Then, in addition, P induces a one-step transition matrix P for a Markov 
chain in the quotient set (i.e., the set of equivalence classes) E/~ defined by the 
formula 

P([x},[y}):= ]T P(x,y')= £ P(x,y a ), (4) 

y'-.y'r^y (T&G-.ycr distinct 
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the second sum extending over only those a £ G for which the various y a are 
distinct. Furthermore, if P has a unique stationary distribution tt, then the 
unique stationary distribution ir is given by ir(x) — 7f([x])/|[a;]|, where \[x]\ 
denotes the cardinality of the equivalence class [x] . 

As we saw in [4], Lemma 1 applies to Pb of (1) and (2) with G being the 
subgroup of cyclic permutations (or rotations) of (1, 2, . . . , N). If p% = p 2 , 
then Lemma 1 also applies to Pg with G being the subgroup generated by 
the cyclic permutations and the order-reversing permutation (rotations and/or 
reflections) of (1,2,..., N), the dihedral group of order 2N. The resulting one- 
step transition matrix Pb has smaller dimension than Pg (see Table 1 of [4]), 
thereby making matrix computations feasible for larger N. 

If Po = Pi = P2 — P3 — 1/2, we denote Pb by P4. Of course the same 
conclusions apply to Pa- We would like to argue that they also apply to P^Pg 
for each r,s > 1. For this we need to show that the mapping P 1— > P has a 
certain multiplicative property. 

Given a subgroup G of Sjsr, let us say that a square matrix P (not necessarily 
stochastic) with rows and columns indexed by S is G-invariant if (3) holds. If 
P is G-invariant, then we can define P as in (4). 

Lemma 2. Let G be a subgroup of Sjf. If the square matrices Pi and P 2 are 
G-invariant, then P\P 2 is G-invariant, and P\P 2 = P\P 2 - 

Proof. The first assertion follows from the identity 

[P 1 P 2 }{x a ,y a ) = J2 p i( x ^ z Wz,Va) = S ^Pi(x <y ,z (J )P 2 {z (y ,y <y ) 

zGE zSE 

= ^2P 1 (x,z)P 2 (z,y) = [PtP^y). 

zGE 

The second is a consequence of 

\P l P 2 }{[xUy])= E \ p i p *\M) 

y'-y'~y 
^ ^2Pi(x,z)P 2 (z,y') 



y'-y'~y 

E 

z y'-y'^y 



:px( x ,z) e p ^y') 

z y'.y'~y 
= ^Pi(x,z)P 2 ([z],[y}) 

Z 

= E E P^z')P 2 ([z'],[y}) 

[z] z':z'~z 

= E^(M>M)M*Ui/]) 

[z] 

= [P 1 P 2 ]([x],[y]), 

so the proof is complete. □ 
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With G being the subgroup of cyclic permutations or (if pi — p 2 ) the dihedral 
group of order 2N, Pa and P B are of course G-invariant. Consequently, for each 
r, s > 1, Lemma 2 tells us that P"aP b is G-invariant as well. This fact will be 
needed in the next section. 



3 Strong Law of Large Numbers 

We will need the following version of the SLLN. 

Theorem 3 (Ethier and Lee [13]). Let Pa and Pb be one-step transition ma- 
trices for Markov chains in a finite state space S . Fix r i s > 1- Assume 
that P := P T A P B , as well as all cyclic permutations of P A P B , are irreducible 
and aperiodic, and let the row vector ir be the unique stationary distribution 
of P. Given a real-valued function w on So x ^o, define the payoff matrix 
W := (w(i,j)) i: j & z . Define Pa ■— Pa W and Pb := Pb ° W , where o 
denotes the Hadamard (entrywise) product, and put 



1 



r-l s-1 

J2^PaPa1 + J2^ P a P bPb1 



where 1 denotes a column vector of Is with entries indexed by So- Let {X„}„>o 
be a nonhomogeneous Markov chain in So with one-step transition matrices 
P A , ...,P A (r times), P B ,...,P B (s times), P A , ■ ■ , Pa (r times), P B ,...,P B 
(s times), and so on, and let the initial distribution be arbitrary. For each n > 1, 

define £ n := w(X n _ 1 ,X n ) and S n := £H h£ n - Then Iim n _,.oo n~ 1 S n = 

a.s. 

Here "a.s." stands for "almost surely," meaning "with probability 1." 

Our original Markov chain has state space S := {0, 1}^ and its one-step 
transition matrix P B is given by (1) and (2), but Theorem 3 does not apply 
directly. Instead, we augment the state space, letting S* := S x {1,2, . . . ,N} 
and keeping track not only of the status of each player as described by x G S but 
also of the label of the next player to play, say i. The new one-step transition 
matrix P B has the form 



._ )N 1 P„ H ( X ) if x t = 0, 
N~ 1 q mi ( x ) if Xi = 1, 



P B {(x,i),{x\j)):={ ." mi ™ .; i ;' (x,i)eE*, j = l,2,...,N, 



N 1 q„ H ( x ) if a;; = 0, 

^^Pm,!^ ifXi=l, 



P B ((x,i),(x,j)):={ ' .; i (,,i)eE*,i = l,2 1 ...,JV, 



where q m := 1 — p m for m = 0,1,2,3, and P B ((x,i), (y,j j) = otherwise. 
If po = pi = P2 = P3 = 1/2, we denote P B by PJJ. The one-step transition 
matrix P* := (P A ) r (P B ) s , as well as all cyclic permutations of (P A ) r (P B ) s , 
are irreducible and aperiodic, so let ir* be the unique stationary distribution 
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of P* . The payoff matrix W now has each nonzero entry equal to ±1, so 
Theorem 3 applies. Since -P4I = 0, we have 

s-l 

^s]^—Y,^( p An p B) v PB^ (5) 

' -u=0 

where 1 denotes a column vector of Is with entries indexed by E*. Here P B 
is the Hadamard (entry wise) product P B o W , where W is the matrix each of 
whose entries is 1, —1, or according to whether the corresponding entry of P B 
is of the form N~ 1 p m , N~ 1 q m , or 0. 

Lemma 4. Fix r, s > 1 and Zef 7r 6e i/ie unique stationary distribution of P A P B . 
Then (P A ) r (P B ) s has unique stationary distribution ir*(x,i) :— ir(x)N~ 1 and 

ln*(PZnP* B r}(x,i) = [nP^WN- 1 (6) 

for v = 0, 1, . . . , s — 1. 

Proof. Let 7r* be stationary for (P A ) r (P B ) s . We will show that it has the 
form stated in the lemma. Let X* (0), . . . , X* (r + s) be a nonhomogeneous 
Markov chain in E* with one-step transition matrices P A ,...,P A (r times), 
Pg, . . . , Pg (s times), and initial distribution tv* . Then X*(r + s) has dis- 
tribution Tr*(PX) r (P B ) s = 7T*. Let X(0), X(r + s) be the projections of 
X*(0), . . . , X* (r + s) onto S, and let 7r be the marginal of iz* on S. Then 
X(0), . . . , X(r + s) is a nonhomogeneous Markov chain in E with one-step tran- 
sition matrices Pa, ■ ■ ■ , Pa (t times), Pb, ■ ■ ■ , Pb (s times), and initial distribu- 
tion 7r. Furthermore, X(r + s) has distribution ttP^P b as well as distribution 
7r. So 7r is the unique stationary distribution of P^P g , as assumed in the state- 
ment of the lemma. On the other hand, writing X*(r + s) = (X(r + s), I(r + s)), 
I(r + s) is independent of X(r + s) and uniformjl, 2, . . . , N}. So the distribution 
7r* of X* (r + s) must have the stated form. 

Finally, fix v € {0, 1, . . . , s - 1} and write X*(r + v) = (X(r + v), I(r + v)). 
The left side of (6) is the distribution of X*(r + v), while [tzP^P%\{x) is the 
distribution of X(r + v). Further, I(r + v) is independent of X{r + v) and 
uniform{ 1, 2, • • • , N} by virtue of the one-step transition matrices jPJJ and P B . 
This implies (6). □ 

It follows from (5) and Lemma 4 that 

^M^E^WbI, (7) 

v—0 

where Pb is obtained from P B by replacing each q m by — q m (prior to any 
simplification using q rn = 1 — p m ) and 1 denotes a column vector of Is with 
entries indexed by E. This expresses the mean profit /i[ r . s ] in terms of the 
original one-step transition matrices Pa and Pb and the unique stationary 
distribution n of P r A P B . However, for computational purposes, we would like 
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to express it in terms of the reduced one-step transition matrices Pa and Pb 
and the unique stationary distribution tv of P A P B . The subgroup G implicit in 
the notation is either the subgroup of cyclic permutations of (1, 2, . . . , N) or (if 
Pi = P2) the dihedral group of order 2N. 

Theorem 5. Given r, s > 1, let {(X(n), I(n))} n >Q be the nonhomogeneous 
Markov chain in E* with one-step transition matrices P A , . . . , P A (r times), 
P B , . . . , Pg (s times), PJ, . . . , P\ (r times), P B , . . . , P B (s times), and so on, 
and arbitrary initial distribution. Define 

e„ :=w((X(n-l),I(n-l)),(X(n),I(n))), n > 1, 

where the payoff function w is 1 /or a win and —1 /or a loss, determined by 
whether the corresponding entry of P B is of the form N~ 1 p rn or N~ 1 q m . Let 
S n '■= £1 + • • • + £n f or each n > 1. TTien n~ 1 S n — > jtxr rjS ] a.s., where 



1 5-1 

M[M = T— £* P -A P iW, (8) 

u= 

i^B 2s obtained from Pb by replacing each q m by —q m (prior to any simplification 
using q m = 1 — p m ), o,nd 1 denotes a column vector of Is with entries indexed 
by E/~. 

Proof. This is an application of Theorem 3. To show that the right sides of (7) 
and (8) are equal, we note that, for any G-invariant square matrix Q, we have, 
using Lemma 1, 

*Q 1 = Y Y.nWQfav) 

= Y Y Y Y <*)Q&rf) 

x':x'~cc [y]eE/~ y'-y'~y 

= E E E Tr^oQd^jtf]) 

[cc]GS/~ x':x'~x [»]eS/~ 

= E E <*)IMIQ([*My]) 
= E E *([*])<3([*]>M) 

[x]er/~ [y]es/~ 

= ttQ1, (9) 

where 1 denotes a column vector of Is of the appropriate dimension. Now if Pb 
is G-invariant, then so too is Pb, and likewise for Q v :— P t a P b Pb by Lemma 2; 
using (9) and Lemma 2, 

kP t a P v b P b \ = wQ v l = TtQ v l = *P r A P v B P B l 

for v = 0, 1, . . . , s - 1. (Note that P = P.) □ 
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We conclude with an application of the SLLN for this model. 

Let us denote /is, the mean profit per turn to the ensemble of N players 
always playing game B, by plb{pqiPi,P2,P3) to emphasize its dependence on the 
parameter vector. As shown in [4], 

Hb{po,Pi,P2,P3) = -Mb(<73,<72,<7i,<7o), (10) 

where q m := 1 — p m for m = 0, 1, 2, 3. Fix r, s > 1. Let us denote /J>[ r<s ] of (5), 
(7), or (8) by fi[ r , s ](Po,Pl,P2,P3)- 

Corollary 6. 

tt[r,8](po,Pi,P2,Ps) = -l*{r,8](qa,92,qi,qo)- 
In particular, if p + p 3 = 1 and pi +p 2 = l, then ^[ r , s ](Po,Pi,P2,P3) = 0. 

Proof. (10) was proved in [4] using a coupling argument. The proof of the 
corollary is the same, except that the (homogeneous) Markov chain is replaced 
by the nonhomogeneous one in the statement of Theorem 5. □ 

4 Reducible Cases 

We have assumed that < p m < 1 for m = 0,1,2,3, which ensures that 
the Markov chain for game B is irreducible and aperiodic. This assumption 
was weakened to some extent in [4]. We can derive the results obtained here 
under analogous conditions by noticing that the irreducibility and aperiodicity 
assumptions of Theorem 3 can be weakened to simply ergodicity, which requires 
a unique stationary distribution and convergence of the distribution at time n 
to that stationary distribution as n — > oo, regardless of the initial distribution. 

Fix r,s > 1. We first notice that the Markov chain in £ with one-step 
transition matrix P a ~ 1 P b Pa, P"^" 1 P b P\i ■ ■ ■ , or P B P T A is ergodic (in fact, 
irreducible and aperiodic) for all choices of the parameters Po,Pi,P2,P3 € [0, 1]. 
It remains to check the ergodicity of the Markov chain in £ with one-step 
transition matrix P s B l P\P B , P^P^P*, . . . , or P r A P s B . We denote by e S 
the state consisting of all 0s, and by 1 € S the state consisting of all Is. 

1. Suppose p = 1 and < p m < 1 for m = 1,2,3, as Toral [1] originally 
assumed. Then state cannot be reached from £ — {0} by Pb and 
therefore by P^P^Pb, P s B 2 P r A Pl, and P r A P s B - For these one- 
step transition matrices, E — {0} is irreducible and aperiodic while is 
transient. Thus, the required ergodicity holds. Theorem 3 (modified as 
noted above) and Theorem 5 apply. 

2. Suppose po = a nd < p m < 1 for m = 1, 2, 3. Then state is absorbing 
for Pb, and absorption occurs with probability 1, so fis = — 1. However 
P^~ 1 P^Pb, P b ~ 2 PaPb, ■ , and P A P B are all irreducible and aperiodic 
in E. Consequently, Theorem 3 (as stated) and Theorem 5 apply. 

3. Suppose p 3 = and < p m < 1 for m — 0, 1, 2. This is analogous to case 
1 but with the role of played by 1. 
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4. Suppose p 3 = 1 and < p m < 1 for to = 0, 1, 2. This is analogous to case 
2, except that state 1 is absorbing for game B and fj,g = 1- 

5. Suppose po — lj P3 — 0, and < p m < 1 for to = 1, 2. Then states and 
1 cannot be reached from E — {0, 1} by Pg and therefore by P B ~ l P T A P B , 
P B ~ 2 P^P B , . . . , and P^P B . For these one-step transition matrices, E — 
{0, 1} is irreducible and aperiodic while and 1 are transient. Thus, the 
required ergodicity holds. Again, Theorem 3 (modified) and Theorem 5 
apply. 

6. Suppose po = 0, ps = 1, and < p m < 1 for to = 1,2. Then both 
and 1 are absorbing for Pg, and absorption occurs with probability 1. 
However, the Markov chain with one-step transition matrix P B l P^Pg, 
P B ~ 2 P^P B , . . . , or P^P B has different behavior. If N is odd, it is irre- 
ducible and aperiodic in E, whereas if N is even, E — {01 • • • 01, 10 • • • 10} is 
irreducible and aperiodic and 01 • • • 01 and 10 • • • 10 are transient. Again, 
Theorem 3 (as stated if N is odd, modified if N is even) and Theorem 5 
apply. 



5 The Parrondo Region 

In this section we assume that p\ — P2, so that the coin tossed in game B 
depends only on the number of winners among the two nearest neighbors. For 
fixed N > 3 and r, s > 1, we have three free probability parameters, Po,Pi, and 
ps, so our parameter space is the unit cube (0, l) 3 := (0, 1) x (0, 1) x (0, 1). With 
caution (see Sec. 4), we can also include parts of the boundary. Of interest are 
the Parrondo region, the subset of the parameter space in which the Parrondo 
effect (i.e., p B < and fJ,[ r , s ] > 0) appears, and the anti-F 'arrondo region, the 
subset of the parameter space in which the anti-Parrondo effect (i.e., fig > 
and H[ r _ s ] < 0) appears. 

Theorem 7. Fix N > 3 and r,s > I. With q m := 1 — p m for to = 0,1,3, 
the parameter vector (po,Pi,Pz) belongs to the Parrondo region if and only if 
the parameter vector {q3,qi,qo) belongs to the anti-Parrondo region. In partic- 
ular, the Parrondo region and the anti-Parrondo region have the same (three- 
dimensional) volume. 

Proof. Let [i B and fi\ riS ] denote the means for the parameter vector (po,Pi,P3), 
and let \x* B and /uf rs i denote the means for the parameter vector (93,91,50)- 
Then, by (10) and Corollary 6, ^ B = Hb(po,Pi,Pi,P3) = "Msfe, 9i, 5i> Qo) = 
-p* B and [i [rtS] = fi[r, a ](po,Pi,Pi,Pa) = -M[r,»] (?3, 5i> Ql, Qo) = — Mjy.s] ■ There- 
fore, fi B < and /i[ r , s ] > if and only if /i* B > and juf rs i < 0. Since the 
transformation 

Hpo,Pi,P3) ■= (1 -Pa, 1 - Pi, 1 - Po) 

from (0, l) 3 to (0, l) 3 has Jacobian identically equal to 1, the final conclusion 
holds. □ 
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We can therefore focus our attention in what follows on the Parrondo region. 
Using the mean formula (8) in terms of the reduced Markov chains, together 
with the assumption that p\ — P2, when N = 3 we find that 

5[2pi(3 + po + 93) - 3<?o - 5g 3 ] 



- 2(17+ 15p + Wi + &Poq 3 + W 3 + + 19®,) ' 
M[i,2] - 2[-494 + 287p - 51p 2 + 181p 3 - 13p p 3 - I2p 2 p 3 + U2p% - A0 Po p 2 3 

+ (520 + 61p - 65^ - H3pg + 130p o p 3 - 28p 2 p 3 - 65p 2 + 2%p p 2 ) Pl 

- 2(1 -po- p 3 )(13 + 7 Po - 7p 3 )p?]/{3[494 + 335p - 154p^ 

- 157p 3 - 64p p 3 + 32p2 p3 _ uOp 2 - Q4 P() p 2 + 32p 2 p 2 

- 2(1 - po - p 3 )(89 - 8p + 16p 3 - I6p p 3 )pi + 8(1 - Po - P 3 ) 2 P?]}, 

38[pi(12+p + g 3 )-6go-7 g3 ] 

3(367 + lllp + 8p pi + 16p g 3 + 8pip 3 + 6q t + 119g 3 ) ' 

Pi(Po +?3) - 93 



M[2,l] = 

Since 



P0P1 +2p g 3 + 9i93 



(see [4]), the Parrondo region for the [1, 1] pattern is described by pi(po + 93) 
q 3 < and 2pi(3 + po + 93) — 3qo — 5q 3 > 0, or, equivalently, 

39o + 5g 3 g 3 
< Pi < 



2(3+p + 93) Po + 93' 

Similarly, the Parrondo region for the [2, 1] pattern is described by 

690 + 793 . . 93 
12+p +<7 3 Po + 93 

With the parameter space being the (po,P3,Pi) unit cube, the Parrondo region 
is the union of two connected components. See row 1 of Figure 2. For the [1, 1] 
pattern, integration yields its exact volume, (100 In 5 + 36 In 3 — 276 In 2 — 9)/8 « 
0.0231515. For the [1, 2] pattern, numerical integration gives its approximate 
volume, 0.0166398. For the [2, 1] pattern, integration results in its exact volume 
(rounded), 0.0268219. 

In [4] we pointed out a close relationship between the spatially dependent 
Parrondo games with N — 3 and the history-dependent Parrondo games of 
Parrondo, Harmer, and Abbott [18]. Specifically, the Parrondo regions for the 
equally weighted random mixtures were shown to be equal in the two models. 
The analogous result for the nonrandom pattern [1, 1] fails, however. 

When N = 4 or N = 5, we have explicit, albeit very complicated, formulas 
for i-J.[ r .s] with r + s < 3. It would be impractical to state those formulas here. 
Instead, we plot the Parrondo regions and the anti-Parrondo regions for these 
cases in rows 2 and 3 of Figure 2. They are surprisingly similar to the regions 
for the random- mixture cases depicted in [4]. 
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Figure 2: When N — 3 (row 1), N = 4 (row 2), or iV = 5 (row 3), the green 
(or light) surface is the surface /ib — 0, and the red (or dark) surface is the 
surface /X[ r , g ] = with [r,s] = [1,1] (column 1), [r, s] = [1,2] (column 2), or 
[r, s] = [2,1] (column 3), all in the (po,P3 7 Pi) unit cube. The Parrondo region 
is the region on or below the green surface and above the red surface, while the 
anti-Parrondo region is the region on or above the green surface and below the 
red surface. (Assumption: p\ — P2-) 
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Table 1 displays the mean profits /i[ rjS ] for 3 < N < 18 and the six choices of 
[r, s] with r+s < 4 for Toral's choice of the probability parameters (po,pi,p2,p 3 ) = 
(1,4/25,4/25,7/10). Computations were done using Mathematica 8 and a mi- 
nor modification of the program displayed in Appendix A of [4] . By Table 3 
of [4], fi B < for 3 < N < 18 except for N = 4,7,8, so the Parrondo effect 
is present except in 22 of the 96 cases. Furthermore this calculation suggests 
that each mean /i[ rjS ] converges to a limit as N —> oo, although the rate of 
convergence is much slower than in the random-mixture case. 

In fact, in [6] we proved that, under certain conditions (see Appendix A 
herein), fi\ ra i converges to the same limit that jj,^ i i_ 7 ), the mean profit of the 
randomly mixed game jA + (1 — "f)B, converges to, where 7 := r/(r + s). The 
last row of Table 1 shows this limit. Tables 2 and 3 analyze two other examples, 
a second point on the boundary of the unit cube and a point in the interior. 
These are the same examples as the ones studied in [4]. 

To illustrate the slower convergence rate, let us consider the example p — 
1/10, pi ~ P2 — 3/5, and p^ = 3/4. By N = 18, A*[i.i] matches its limiting value 
to only two significant digits. On the other hand, by N = 19 (the largest N 
for which computations have been done in the random-mixture case), hb has 
stabilized to four significant digits and fJ-n/2, 1/2) has stabilized to 11 significant 
digits. 

For N = 18, M = [1,3], [2,2], or [3 L l],_and Po , Pl (= p 2 ),P 3 G (0,1), 
evaluation of the stationary distribution of P^P B is computationally intensive 
because 32.4% of the 59,059,225 entries of this one-step transition matrix are 
nonzero. This is the reason we stopped with N = 18. On the other hand, 
only 0.236% of the entries of the one-step transition matrix (r + s) (tPa + 
sPb) are nonzero, so it is relatively easy to calculate its stationary distribution. 
Furthermore, the faster convergence in the random-mixture case allows us to 
obtain six significant digits of limjv_ i . 00 /i( r /( r+s ) tS /(r+s)) using only the computed 
values for N < 18. 

6 Conclusions 

We considered the spatially dependent, or cooperative, Parrondo games of 
Toral [1], which assume N > 3 players arranged in a circle, and in which the 
win probability for a player depends on the status of the player's two nearest 
neighbors. There are three games, game A without spatial dependence, game B 
with spatial dependence, and the nonrandom periodic pattern A r B s , or [r, s], 
with r,s > 1. The model is described by a Markov chain with 2 N states and 
parameters p$,pi,p2,Pz- To maximize the value of N for which exact compu- 
tations are feasible, we assumed p\ = p 2 and regarded states as equivalent if 
they are equal after a rotation and/or reflection of the players. This allowed 
us to compute the mean profits per turn, ^[ r . s ], to the ensemble of N players 
for 3 < N < 18 and r + s < 4 and several choices of the parameter vector 
(^05^1:^3)1 including Toral's choice. The results provide numerical evidence, 
but not a proof, that H[ r , s ] converges as N — > 00 and that the Parrondo effect 
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Table 1: Assuming (po , Pi , P2 , P3) — (1,4/25,4/25,7/10), entries give (Jt[ r , a ] to 
six significant digits (in most cases) for 3 < N < 18 and six choices of [r,s]. 
By [4], (x B < for 3 < N < 18 except for N = 4, 7, 8, so the Parrondo effect is 
present except in 22 of the 96 (= 16 x 6) cases. Also given, in the last row, is 
limjv-s.00 A*[r,s] to srx significant digits. 

TV [r, s] 



[1,1] [1,2] [1,3] [2,1] [2,2] [3,1] 



3 


-0.00695879 


-0 


.02748212 


-0.04021572 





.00067249 


-0 


.01487182 


0.00179203 


1 


0.00877041 





.02345828 


0.03569464 





.00352220 





.01011944 


0.00244238 


5 


0.00466232 





.00501198 


0.00434917 





.00320648 





.00465517 


0.00240873 


6 


0.00497503 





.00590528 


0.00513509 





.00325099 





.00498178 


0.00241857 


7 


0.00496767 





.00621483 


0.00637676 





.00326314 





.00497331 


0.00242540 


8 


0.00494802 





.00604194 


0.00599064 





.00327193 





.00495138 


0.00243115 


9 


0.00493507 





.00598135 


0.00588386 





.00327802 





.00493728 


0.00243582 


10 


0.00492347 





.00593756 


0.00584200 





.00328237 





.00492494 


0.00243961 


11 


0.00491339 





.00589846 


0.00578690 





.00328558 





.00491438 


0.00244272 


12 


0.00490464 





.00586697 


0.00574489 





.00328800 





.00490531 


0.00244529 


13 


0.00489699 





.00584063 


0.00571065 





.00328986 





.00489744 


0.00244745 


14 


0.00489026 





.00581820 


0.00568131 





.00329133 





.00489056 


0.00244927 


15 


0.00488431 





.00579891 


0.00565623 





.00329249 





.00488449 


0.00245083 


16 


0.00487900 





.00578213 


0.00563452 





.00329343 





.00487912 


0.00245217 


17 


0.00487426 





.00576740 


0.00561552 





.00329420 





.00487432 


0.00245334 


18 


0.00486999 





.00575438 


0.00559876 





.00329483 





.00487001 


0.00245437 


00 


0.00479089 





.00554084 


0.00532972 





.00329853 





.00479089 


0.00246903 



(i.e., hb < and fi[ r , s ] > 0) persists for all N sufficiently large for a set of pa- 
rameter vectors having nonzero volume. As we noted in [4], this suggests that 
the spatially-dependent version of Parrondo's paradox is a robust phenomenon 
that remains present in the thermodynamic limit. 

This is the main conclusion, but there are several other noteworthy findings. 
We have shown that the sequence of profits to the ensemble of N players obeys 
the strong law of large numbers. This is relevant to defining what is meant 
by a winning, losing, and fair game. For N — 3,4,5 and r + s < 3, explicit 
formulas for /ib and £t[ r ,s] are available, so with the help of computer graphics, 
we have demonstrated that one can visualize the Parrondo region, the region 
in the three-dimensional parameter space in which the Parrondo effect appears. 
There is also an anti-Parrondo region, and we have shown that it is symmetric 
with the Parrondo region, as might be expected. 

We have restricted our attention to the one-dimensional version of the model, 
but our methods may have applicability to the two-dimensional version, already 
investigated by Mihailovic and Rajkovic [19] using computer simulation. In a 
separate paper [6] we prove, under conditions that can likely be improved (see 
Appendix A below), the convergence of /Ltr r)S i as N — > 00, and we express the 
limit in terms of a spin system on the one-dimensional integer lattice. 
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Table 2: Assuming (po,p%,P2,P3) = (7/10, 17/25, 17/25,0), entries give fi\ r ,s] to 
six significant digits (in most cases) for 3 < N < 18 and six choices of [r,s]. 
By [4], fiB < for 3 < N < 18 except for N — 3, 5, so the Parrondo effect is 
present except in 13 of the 96 cases. 

N [r, s] 



[1,1] [1,2] [1,3] [2,1] [2,2] [3,1] 



3 


0.02224875 





.04081923 


0.04914477 





.01124438 


0.02978942 


0.00756605 


1 


0.00771486 





.00053987 


-0.00667489 





.00804643 


0.00719297 


0.00668482 


5 


0.00959590 





.00896406 


0.00788233 





.00808935 


0.00944220 


0.00660145 


6 


0.00883530 





.00657582 


0.00395457 





.00787821 


0.00870056 


0.00649756 


7 


0.00866607 





.00674014 


0.00456448 





.00774894 


0.00856648 


0.00641956 


8 


0.00847909 





.00646246 


0.00421207 





.00764628 


0.00840151 


0.00635716 


9 


0.00834684 





.00633835 


0.00413293 





.00756557 


0.00828507 


0.00630657 


10 


0.00824074 





.00622264 


0.00402604 





.00750030 


0.00819047 


0.00626485 


11 


0.00815521 





.00613328 


0.00394982 





.00744652 


0.00811356 


0.00622992 


12 


0.00808457 





.00605892 


0.00388449 





.00740147 


0.00804952 


0.00620028 


13 


0.00802529 





.00599680 


0.00383017 





.00736319 


0.00799540 


0.00617485 


14 


0.00797483 





.00594398 


0.00378377 





.00733029 


0.00794905 


0.00615279 


15 


0.00793135 





.00589853 


0.00374381 





.00730171 


0.00790890 


0.00613348 


16 


0.00789351 





.00585901 


0.00370899 





.00727665 


0.00787378 


0.00611645 


17 


0.00786027 





.00582433 


0.00367839 





.00725451 


0.00784280 


0.00610132 


18 


0.00783085 





.00579365 


0.00365129 





.00723480 


0.00781528 


0.00608779 


oo 


0.00734784 





.00529172 


0.00320388 





.00689768 


0.00734784 


0.00584750 
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Appendix A 

We have stated (referring to [5] and [6] for details) that, under certain conditions 
on po,pi,p2,pz and [r,s], the means [Ib and /Z[ rjS ] converge as N — > oo. We 
would like to briefly describe the conditions and identify the limits. 

The limits depend on the spin system in the infinite product space {0, 1} Z 
(Z being the set of integers) with generator of the form 

(^ B f){x) :=Y,^( X )[f(x 1 )- f(x)l (11) 
iez 
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Table 3: Assuming (po , Pi , P2 , P3) = (1/10,3/5,3/5,3/4), entries give (i[ r , a ] to 
six significant digits (in most cases) for 3 < N < 18 and six choices of [r,s]. 
By [4], [Ib < for 3 < N < 18, so the Parrondo effect is present except in 2 of 
the 96 cases. 



N [r, s] 







[1,1] 


[1,2] 


[1,3] 




[2,1] 


[2,2] 


[3,1] 


3 





.0064599 


-0.0113380 


-0.0305982 





.00792562 


0.0013604 


0.00640450 


1 





.0143185 


0.0137926 


0.0079878 





.00959254 


0.0141773 


0.00690030 


5 





.0154167 


0.0187545 


0.0174399 





.00977539 


0.0153785 


0.00699045 


6 





.0155020 


0.0197053 


0.0197681 





.00980464 


0.0154761 


0.00703029 


7 





.0154423 


0.0197654 


0.0202208 





.00980993 


0.0154198 


0.00705342 


8 





.0153749 


0.0196547 


0.0201990 





.00980937 


0.0153555 


0.00706817 


9 





.0153182 


0.0195309 


0.0200777 





.00980683 


0.0153015 


0.00707811 


10 





.0152717 


0.0194237 


0.0199518 





.00980357 


0.0152575 


0.00708508 


11 





.0152334 


0.0193346 


0.0198414 





.00980014 


0.0152212 


0.00709014 


12 





.0152014 


0.0192605 


0.0197479 





.00979677 


0.0151908 


0.00709392 


13 





.0151742 


0.0191982 


0.0196688 





.00979356 


0.0151649 


0.00709679 


14 





.0151508 


0.0191452 


0.0196013 





.00979055 


0.0151427 


0.00709903 


15 





.0151306 


0.0190994 


0.0195432 





.00978777 


0.0151233 


0.00710080 


16 





.0151128 


0.0190596 


0.0194927 





.00978519 


0.0151064 


0.00710221 


17 





.0150971 


0.0190246 


0.0194483 





.00978280 


0.0150913 


0.00710337 


18 





.0150831 


0.0189936 


0.0194090 





.00978060 


0.0150779 


0.00710431 


00 





.0148448 


0.0184829 


0.0187645 





.00973219 


0.0148448 


0.00710942 



where 

*(x) := <r miW (12) 




and rrii(x) := 2xi-\ + Xi+\ and q m := 1 — p m for m — 0, 1, 2, 3. Intuitively, a 
"spin," or 1, is associated with each "site" i £ Z, and the spin is "flipped" 
at site i at exponential rate Ci{x). If the sum in (11) were finite, this would 
define a pure-jump Markov process, but because the sum is infinite, it defines 
a Markov process with instantaneous states. See Liggett [20] for a thorough 
account of spin systems. 

We have shown in [5] that the spin system with generator jSfg is ergodic 
(i.e., it has a unique stationary distribution and the distribution at time t con- 
verges weakly to that stationary distribution as t — > 00, regardless of the initial 
distribution) if at least one of the following four conditions is satisfied: 

max(|p — Pi|, \P2 - P3\) +max(|p — P2I, \pi — < 1; (13) 

< min(p ,P3) < min(pi,p 2 ) < max(pi,p 2 ) < max(p ,P3) < 1; (14) 
max(p 1 ,p 2 ,P3,Pi +P2-P3) -P3 < Po/2 < min(pi,p 2 ,P3,Pi + P2 - P3); (15) 

PO,Pl,JJ2,P3e(2p-l,5#)n(0,l), P--={P0+Pi+P2+P3)/4. (16) 
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Under the assumption that p\ = P2, the (three-dimensional) volumes of the 
regions described by (13)— (16) are respectively 7/12, 1/3, 7/32, and 2/3. The 
volume of the union of these four regions is 3323/4032, representing about 82.4% 
of the parameter space. Of our three examples (Tables 1-3), only the third one 
belongs to this union. 

It is shown in [5] that, if the spin system with generator ££b is ergodic with 
unique stationary distribution ttb, then the mean \ib converges as N —¥ oo to 

l l 

2^2^2(tt b )-i,i(u,v)p2u+v - 1, (17) 
u=o v=a 

where (~k b )-i,i denotes the —1,1 two-dimensional marginal of 7rg. 

If po = pi = P2 — P3 = 1/2, we denote J£b by J£a- A similar argument 
shows that, if < 7 < 1 and the spin system with generator + (1 — l)-^B 
is ergodic with unique stationary distribution ire, then, for the random mixture 
C := + (1 — j)B, the mean fic converges as N — > 00 to (17) but with ttb 
replaced by n c and each p m replaced by p m :— 7(1/2) + (1 — j)p m . Notice that 
7^4 + (1 — 7)-% is just (11) (with (12)) but with each p m replaced by p m (and 
each q m replaced by q m := 1 — p m ), so the ergodicity condition holds if at least 
one of (13)-(16) holds with each p m replaced by p m . 

Finally, it is shown in [6] that, if the assumption of the preceding paragraph 
holds with 7 := r/(r + s), then the mean /i[ rjS ] converges as N — > 00 to the limit 
of the preceding paragraph with 7 := r j (r + s). 
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